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What is GStreamer 


• Graph based multimedia framework 

• Open source 

• Cross platform 

• Linux, Windows, MacOS, Symbian, ... 

• Multiple languages 

• C, C++, C#, Java, Perl, Python, Vala, ... 
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What is GStreamer used for 


• Media players 

• Video editors 

• Voip and Video call 

• Music editors/composers 

• Camera capture 

• Transcoding 
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What is Buzztard 
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Concepts 
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gstreamer core framework 


pipeline architecture 
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gstreamer plugins 

gstreamer includes over 150 plugins 


3rd party 
plugins 
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GStreamer Core 


• Pipeline layout 

• Elements, Bins and Pads 

• Communication 

• Buffers, Events, Queries and Messages 

• Scheduling 

• Tasks, Queues and Clocks 

• Registry 
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GStreamer Core Libs 


• Base Classes 

• BaseSrc, BaseTransform, BaseSink, ... 

• Check 

• Testing support 

• Controller 

• Parameter automation 
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GStreamer Plugins Base 

Lib s 

• Core is media agnostic 

• gst-plugin-base introduces 

• Audio/Video baseclasses and utilities 

• Lots of helper libraries 
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Elements 


• Elements with static pads 
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Elements 


Elements with "sometimes" pads 


demuxer 






Elements with "request" pads 
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Pads 


• Pads are connectors 

• Elements have PadTemplates 

• Pads are created from PadTemplates 
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Caps 


• PadTemplates have Caps 


audio/x-raw-float 

rate: 
channels: 
endianness: 
width: 

audio/x-raw-int 


[ 1 , 2147483647 ] 
[ 1 , 2147483647 ] 
1234 

{ 32 , 64 } 


• Pads have caps too 
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RAW Audio Caps 


• good support for multi-channel audio 

• audio is interleaved! 

• LRLRLRLR instead of LLLLRRRR 

• Non interleaved support would be nice to 
have 
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Links 


• Elements are linked by linking their pads 

• It is always src -> sink 

• Caps of PadTemplates need to be 
compatible 
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Bins 


• Elements can be grouped 

• Bins are elements themself 


Bin 
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Bins & GhostPads 

• GhostPads are proxies for internal pads 

• Bin + GhostPads = hierarchical graphs 
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Pipeline 


• Toplevel bin 
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Gstreamer pipeline for a basic ogg player 
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Big Pipelines ? 
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Big Pipelines ? 



44 threads, 341 elements :) 
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Communication 

• Buffers, Events, Queries & Messages 
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Threads 


• Pads run in streaming threads 
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Clocks 


• Elements can offer a clock 

• The pipeline selects one 

• All sinks synchronize to it 
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Element States 


• NULL: inactive 

• READY: check ressources 

• PAUSED: preroll 

• PLAYING: active dataflow, clocks are 
ticking 
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Plugins 


• Provide system or user wide features 

• /usr/lib/gstreamer-0.10/ 

• /home/user/.gstreamer-0.10/plugins/ 

• Features are element factories, type 
finders, etc. 
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Registry 


• Cache of plugins and the plugin features 

• Introspected from available plugins 

• Automatically checked at startup 

• Updated if needed 
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Audio Elements 


• Audio I/O 

• alsa, jack, pulse, esound, oss, ... 

• Tools 

• audioconvert, audioresample, adder, 
(de)interleave 

• Effects 

• a few native (—15), ladspa, Iv2, 
buzzmachines 

• Muxers, Demuxer and Codecs 
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Sequencer 


• GstController subsystem 

• Time based parameter changes 



1. May 2010 


Stefan Kost <ensonic@sonicpulse.de> 






















A simple C Example 


• 145 lines of C for a stupid sound 
sequence 

• Simple pipeline 

simsyn ! audiodelay ! autoaudiosink 

• Sequencer controls "simsyn" 
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Resources 


• docs, mailing-lists, ... 

• irc://irc.freenode.org/#gstreamer 


• irc://irc.freenode.org/#buzztard 
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Thank you! 


Stefan Kost <ensonic@sonicpulse.de> 


Some statistics 


• 10 years of development 

• -500 contributor (30 active) 
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GObject 


• Written in C, but still 00 

• We're using GObject 

• Inheritance 

• Interfaces 

• Introspectable properties 

• Signals 
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Logging 


• Powerful logging subsystem 

• Level, categories, ... 

• Run apps with: 

GST DEBUG="* : 2 ,GST CAPS:4" 


./myapp 
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Pipeline dumps 


• Dump pipelines as graphviz graphs 

• Use dot to render them 

• Run apps with: 

GST_DEBUG_DUMP_DOT_DIR=$PWD ./myapp 
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Tools 


• gst-inspect 

• Show known plugins 

• gst-launch 

• Run pipelines on the fly 
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Tools 


• gst-inspector 

• gst-debug-viewer 

• gst-gengui 

• gst-tracelib 
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Writing own plugins 


• fdo git repo has a template module 

• App template 

• Plugin template 

• Or find a similar plugin and copy'n'paste 

• All plugin packages have gst/ext/sys dirs 

- Gst - no dependencies 

- Ext - external library dependecies 

- Sys - platform dependencies (kernel) 
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